Optimal investment with intermediate 
consumption and random endowment 

Oleksii Mostovyi 
Carnegie Mellon University, 
Department of Mathematical Sciences, 
5000 Forbes Avenue, Pittsburgh, PA, 15213-3890, US 
(omostovy@andrew.cmu.edu) 

Abstract 

In this paper we study several classical problems of optimal in- 
vestment with intermediate consumption and random endowment in 
incomplete markets. We establish the key assertions of the utility 
maximization theory assuming that both primal and dual value func- 
tions are finite in the interiors of their domains as well as that random 
endowment at maturity can be dominated by the terminal value of 
a self-financing wealth process. In order to facilitate verification of 
these conditions, we present alternative, but equivalent conditions, 
under which the conclusions of the theory hold. 

1 Introduction 

The problem of utility maximization in incomplete markets is one of the cen- 
tral problems in mathematical finance. The theory was developed by He and 
Pearson [sljlol, Karatzas, Lehoczky, Shreve, and Xu 14 1, Karatzas and Shreve 



12l |. Kramkov and Schachermayer la, ll7|, Karatzas and Zitkovic 13[, and 



Zitkovic |21| . In particular, Kramkov and Schachermayer |16l . 1171 ] considered 
the problem of optimal investment from terminal wealth and found minimal 
conditions on the utility function itself as well as the condition on the utility 
function and on the market model, such that several key assertions of the 
utility maximization theory hold. 
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In this paper we consider a problem for an agent, who in addition to 
the initial wealth receives random endowment. The goal of such an agent 
is to consume and invest in a way that maximizes his expected utility. In 
complete market settings this problem is considered by Karatzas and Shreve 



12[, see Chapter 4. Using replication argument, the authors were able to 
reduce the problem to one without endowment. Since in incomplete markets 
such replication might not be possible, alternative techniques were used. For 
example, Cuoco [ij used martingale techniques to reformulate the dynamic 
optimization problem as an equivalent static one. In Markovian settings a 
possible approach is to use a Hamilton- Jacob i-Bellman equation for the value 
function, see Duffie and Zariphopoulou ^ and Duffie, Fleming, Soner, and 
Zariphopoulou Cvitanic, Schachermayer, and Wang ^ considered the 
problem of optimal investment from terminal wealth under the presence of 
random endowment in incomplete semimartingale market. Using the space 
(L°°)* of finitely additive measures as the domain of the dual problem they 
were able to characterize the value function and the optimal terminal wealth 
in terms of the solution to the dual problem. 



In contrast to [2| Hugonnier and Kramkov [10| treated not only the initial 
capital as the variables of the optimization problem, but also the number of 
shares of random endowment. Although this lead to higher dimensionality 
of the problem, it allowed to relax some technical assumptions. Stability of 
this utility maximization problem was investigated by Kardaras and Zitkovic 



15l |. Karatzas and Zitkovic [13| as well as Zitkovic [21|] extended the results 
of Cvitanic, Schachermayer, and Wang ^ to include the intermediate con- 
sumption. Introducing the stochastic clock process and assuming certain 
regularity conditions on the utility stochastic field, they solved several clas- 
sical problems of utility maximization in one formulation. 

Mostovyi 181 considered the problem of optimal investment with inter- 
mediate consumption under the condition that both primal and dual value 



functions are finite in their domains. It is shown in [18[ that such conditions 
are both necessary and sufficient for the validity of the key conclusions of the 
theory. 

Present work extends the results of Mostovyi 181 ] to incorporate random 



endowment process into the model. As in [10| we treat number of shares 
of random endowment as the variables of the optimization problem. This 
approach allows us to obtain the desired conclusions of the utility maximiza- 
tion theory under the minimal conditions on the endowment process, market 
model and the utility stochastic field. Thus we assume that random endow- 
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ment at maturity can be dominated by the terminal value of a self-financing 
nonnegative wealth process as well as that both primal and dual functions 
are finite in the interiors of their domains. In order to facilitate verification 
of the latter conditions, we present an alternative, but equivalent criterion 
in terms of the finiteness of the value functions without random endowment. 
The condition on the endowment can also be formulated in several equivalent 
ways. 

It turns out to be possible to establish some properties of the primal 
and dual value functions on the boundaries of their domains, namely to 
show upper semi-continuity of the primal value function u and lower semi- 
continuity of dual value function. 

The remainder of this paper is organized as follows. In section [2] we 
describe the mathematical model and state our main results. In section [3] we 
prove them. 



We consider a model of a financial market with finite time horizon [0, T] and 
zero interest rate. The price process 5* = of the stocks is assumed 

to be a semimartingale on a filtered probability space (fi, F, P) , where 
the filtration F = {^t)teio,T] satisfies the usual conditions. We assume that 
there are non-traded contingent claims with a payment process F = (F*)^^. 
If g = {qi)^i is the number of such claims then the cumulative payoff of this 
portfolio is given by 



Thus, the random variable qFt stands for the cumulative amount of endow- 
ment received by a holder of q such claims during the time interval [0,t]. 
Both processes S and F are given exogenously. 

In order to consider several utility maximization problems in one formu- 
lation, let us define a stochastic clock as a nondecreasing, cadlag, adapted 
process that starts at zero and has a finite value at maturity T. For nor- 
malization purposes we assume that this value equals to 1 (without loss of 
generality). A stochastic clock k, induces a measure on [0,T]. 

Define a portfolio 11 as a quadruple {x,q,H,c), where the constant x is 
the initial value of the portfolio, vector q gives the number of shares of illiquid 



2 Main Results 
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contingent claims, H = {Hi)f^^ is a predictable S*— integrable process that 
specifies the amount of each stock in the portfolio, and c = (Q)tg[o,T] is the 
consumption rate, which we assume to be optional and nonnegative. 
The wealth process V = (yt)t£[o,T] of such a portfolio is defined as 

Vt = x+ [ HsdSs - [ CsdKs + qFt, t e [0, T]. 
Jo Jo 

A portfolio n with c = and g = is called self-financing. The collection 
of nonnegative wealth processes of self-financing portfolios with initial value 
X > is denoted by ^{x), i.e. 



jr(x) = <X>0: Xt = x 



HjSs, t e [o,r]| , x>o. 



A probability measure Q is an equivalent local martingale measure if Q is 
equivalent to P and any X G .^(1) is a local martingale under Q. We denote 
the family of equivalent local martingale measures by ^ and assume that 

(2.1) ^7^0. 

This condition is essentially equivalent to the absence of arbitrage oppor- 
tunities on the market without endowment and consumption, see Delbaen 
and Schachermayer js], [sj as well as Karatzas and Kardaras 11 1 for the exact 
statements and further references. 

To rule out doubling strategies in the presence of random endowment we 
need to impose additional restrictions. Following Delbaen and Schachermayer 
j^, we say that a nonnegative process in ^(x) is maximal if its terminal value 
cannot be dominated by that of any other process in 

As in 01, we define an acceptable process to be a process of the form 
X = X' — X", where X' is nonnegative and X" is maximal. Following 



Hugonnier and Kramkov [10|], we denote by ^{x,q) the set of acceptable 
processes with initial value x whose terminal value dominates the random 
payoff —qFx : 

(2.2) ^{x, q) ^{X : X is acceptable, Xq = x and Xt + qFr > 0} . 

The set ^{x, q) may be empty for some (x, q) G M^+"^. We are interested in 
the values of x and g, for which ^(x, q) ^ 0, and define 

(2.3) = int{(a;,g) G : 3^:{x,q)^0]. 
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It is proved Lemma 6 in Hugonnier and Kramkov 10|] that 



(2.4) cljr= gM^+^ : ^0} 



where clJ^ denotes the closure of the set ^ in 



As in Zitkovic 2l| , we restrict our attention to the wealth processes with 



nonnegative terminal values. Thus for each (x, q) G clJ^ we denote 

£^[x,q) = {c = (cj)jg[o,T] : c is nonnegative, optional, 
^'"^^ and there exists X G <^(x, q) s.t. X^ — Ctdnt + qF^ > o| . 

For the treatment of the utility maximization problem (12. 7p we need the 
following assumption on the endowment process. 

Assumption 2.1. (-F7')j=i,...,Ar are ^^T-nieasurable functions. There exists 
a maximal nonnegative wealth process X' of a self-financing portfolio, such 
that 



N 

(2.6) > E \Pt\ 



1=1 

Remark 2.2. Since in the definition (12. 5p the endowment process F enters 
only via its terminal value, it was natural to impose a regularity condition 
on Fnp (and not on the whole F) as in the Assumption 12. 1[ This condition 
is equivalent to the assumption on random endowment in Hugonnier and 
Kramkov [l^ (see equation (5)). As a result in order to check that (12. 6p holds 
one can use alternative equivalent conditions in the statement of Lemma 1 
in 



lOj. By the same lemma under Assumption 12.11 (x, 0) G for all x > 0. 

The preferences of an economic agent are modeled with a utility stochastic 
field defined on a positive real line. U : [0, T] x x [0, oo) M, a ^ ([0, T]) (g) 
^ ® =^ ([0, oo)) —measurable function, where ef^(^) denotes the smallest 
cr— field containing all open sets of a topological space S^. We assume that 
U satisfies the conditions below. 

Assumption 2.3. For each (t,aj) G [0,T] x VL the function x — )■ U{t,u,x) is 
increasing, strictly concave, continuously differentiable, satisfies Inada con- 
ditions: 

\imU'(t,u,x) = +00 and lim U'{t,u,x) = 0, 

x],0 x^oo 
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where U'{-,-,-) denotes the partial derivative with respect to the last ar- 
gument, U(t,u,0) = \imU(t,u,x). For each x > 0, the stochastic process 

U{-,-,x) is optional. 

The agent can control investment and consumption. His goal is to do this 
in a way that maximizes expected utility. For any (x, g) G clJ^ he wants to 
compute the value function u, defined as: 



(2.7) 



u{x,q) 



sup E 

c£ji/ {x,q) 



U{t,uj,Ct)dKt 



IfE 



J^U {t,uj,Ct)dKt 



+00 for some c, to ensure that E 



U{t,uj,Ct)dKt 



is well-defined, we let E 



U{t,uj,Ct)dKt 



-00. Here and below U de- 



notes the negative part of the stochastic field U. Also, we set u{x, q) = —00 
for (x, q) G {clJi^y. 

We are primarily interested in the following questions. 

(i) Under what conditions on the market model and on the utility stochas- 
tic field U does the maximizer to the problem (12. 7p exist for every 
(x, g) G {m > —00}? 

(ii) What are the properties of the function ul 

(iii) What is the corresponding dual problem? 

We employ convex duality techniques to answer these questions and define a 
convex conjugate stochastic field V as the pointwise Fenchel-Legendre trans- 
form of the agent's utility U : 

V(t, u, y) = sup {U (t, u, x) — xy) , (t, u, y) G [0, T] x x (0, 00). 

x>a 

To construct the feasible set of the dual problem we define the set =5f as 
the relative interior of the polar cone — : 



(2.8) ^^ri{(2/. 



r G 



xy + qr > for all (x, q) G J^} 



It is proved that is an open set in M^"*"^ if and only if for any q ^ the 
random variable qF^ is non-replicable, see Lemma 7 in 10| for details. 
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By W we denote the set of cadlag densities of equivalent local martingale 
measures: 



te[o,T] 



and for each y > we define 

^(y) = cl {Z : Z is cadlag adapted and 



< ^ < (rfK X P) a.e. for some y e # [ . 



(2.9) 



Here the closure is taken in the topology of convergence in measure [dn x P) 
on the space of optional processes on the probabihty space. Now we are 
ready to set the domain of the dual problem: 
(2.10) 

< + gr 

for all (x, g) G clJ?^ and c G g) } , (y, r) G cl.^'; 

and to state the dual optimization problem itself: 



(2.11) 



v{y,r) 



= inf E 



V{t,U,Yt)dKt 



{y,r) G clJif. 



Similarly to definition of the primal problem, if E J^^ V~^{t,uj,Yt)dKt 



+00, we let E 



J^Vit,u,Y,)dKt 



-oo. Here and below denotes the 



positive part of the field V. Also, let v{y,r) = +oo for all (?/,r) G (cl^)*^. 
The following theorem constitutes the main result of this work. 

Theorem 2.4. Assume that ^2. ij) . Assumptions \2.1 \ and \2.^ hold as well as 
(2.12) 

u{x,q) > — oo for all (x, g) G ^ and v{y,r) < oo for all {y,r) G 
Then 

(i) The functions u, v are finitely valued on and ^ respectively, u and 
V satisfy biconjugacy relations: 



(2.13) 



u{x,q) = inf {v{y,r) + xy + qr} , (x, g) G clJ^; 

(y,r)GclJf 

v{y,r) = sup {u{x,q) — xy — qr} , (y,r)G cl^. 
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(a) The function u is upper semi- continuous, u{x,q) < oo for all (x, g) G 
M^+^. For any (x, g) G {m > —00} there exists a unique maximizer to 
the problem \2. 7\ ). 

The function v is lower semi- continuous, v{y,r) > —00 for all {y,r) G 
]^Ar+i_ (^y^r^ g |y < Qoj there exists a unique minimizer to the 

problem \2.11\) . 

(Hi) For any {x,q) G the subdifferential of u at {x,q) is non-empty. 
Moreover, [y, r) G du{x, q) if and only if the following conditions hold: 



(2.14) 



Ff(l/,r) = f/'(t,a;,Q(x,g)), tG [0,r], 



where Y{y,r) and c{x,q) are optimizers to problems ^2.11\) and \2. 
respectively; 



(2.15) 



E 



Yt{y,r)ct{x,q)dKt 



xy + qr; 



(2.16) 



\v{y,r)\ < 00. 



Remark 2.5. Condition (12.121) might be difficult to verify. Let 



(2.17) w{x)=u{x,0)= sup E 

cei/(x,o) 



U (t, u, Ct) dKt 



X > 0. 



(2.18) 



wiy) = inf E 



V{t,u,Yt) dKt 



y>0. 



In Lemma 12.61 we show that instead of checking (12.121) one can verify an 
equivalent condition: 

(2.19) w{x) > —00 for all X > and w{y) < 00 for all y > 0. 



Note that (12.191) is precisely the condition that was used by Mostovyi 18 
the statement of the main theorem. 



m 



Lemma 2.6. Let Ii2.1\) and Assumptions \2. 1\ \2. 31 hold. Then condition Ii2.12\) 
holds if and only if condition Ii2.19\) holds. 



8 



3 Proofs 



We start from a proposition that gives a useful characterization of the do- 
mains of the primal and dual problems. 



Proposition 3.1. The families (^(a;, g)^^!^ and (^(z/, 
fined in Ii2. 5\) and Ii2.10\) have the following properties: 



de- 



li) For any (x, q) G J(f , the set £^ (x, q) contains a strictly positive constant 
process. For any {x, q) G clJ^ a nonnegative optional process c belongs 
to (x, q) if and only if 
(3.1) 



E 



T 



CtYtdKt 



< xy + qr for all {y, r) G cl^ and Y E "S^ly, r) 



(a) For any {y,r) G =Sf the set '3^{y,r) contains a strictly positive process. 
For any {y, r) G cl=Sf a nonnegative process Y belongs to ^ {y, r) if and 
only if 
(3.2) 



E 



CtYtdKt 



< xy + qr for all (x, q) G cl^ and c G i2/(x, g). 



The proof of Proposition 13.11 is broken into several lemmas. 



Lemma 3.2. Under the assumptions of Theorem \2.4\ u is sub-conjugate of 
V, i.e. for all (x,g) G clJ^, {y,r) G cl=Sf we have: 



(3.3) 



u{x, q) < v{y, r) + xy + qr. 



As a result \u\ < oo on \v\ < oo on u < oo and v > — oo everywhere 
in R^+i. 

Proof. Fix (x, g) G cl^^, {y,r) G cl=Sf. Take arbitrary c G s^{x,q), Y G 
'3^{y,r). It follows from the definition of the conjugate field V that 



E 



U{t,uj,Ct)dKt 



< E 

< E 



U{t,uj,Ct)dKt 
jI^Vit,u,Yt)dKt 



+ xy + gr — E 
+ xy + qr. 



/o CtYtdKt 
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This implies inequality f l3.3p . The remaining assertions of the lemma follow 
from inequality fl3.3p inequality and the assumptions of Theorem 12.41 □ 
As in 10|] we define the set 0^ to be the set of points in the intersection 
of =Sf and the hyperplane y = 1, that is, 



(3.4) 



^^{peR^ : (l,p) G if}. 



Note that under the Assumption 12.11 it follows from Lemma 1 in 10| that 
the set ^ is bounded. 

Let be the set of equivalent local martingale measures Q, such that 
the process X' (in the Assumption 12. ip is a uniformly integrable martin- 
gale. According to Theorem 5.2 in Delbaen and Schachermayer j^, is 
a nonempty, convex subset of which is dense in ^ with respect to the 
variation norm. 

For any p e ^ denote ^'{p) = {Q G : Eq [Ft] = p} At follows from 
Lemma 8 in 10| that (under the conditions (12.1 p and Assumption 12. ip ^'{p) 
is non-empty for every p ^ and 



(3.5) 



U ^\v) 



Lemma 3.3. Let p G . Then the cddldg density process of any Q G ^'{p) 
belongs to W{l,p). 

Proof. Fix an arbitrary (x, g) G clJ^, c G ^{x,q), and X G ^(x,g) such 
that Xt + qFx > jl^ Ctdnt > 0. Taking expectation under Q G ^'{p) and 



^0 

using integration by parts formula we get: 



X + > Ej; 



CtdKt 







E 



-CtdKt 



□ 



Lemma 3.4. Assume that the assumptions of Theorem \2.4\ hold true. For 
any (x, q) G clJ^, a nonnegative optional process c belongs to (x, q) if and 
only if 



(3.6) 



Er 



CtdKt 



< X + qp for all p E ^ and Q G ^\p\ 
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Proof, li c & £/ {x, q) for (x, q) G c\J^ then the vahdity of fl3.6p follows 
from Lemma 13.31 Viceversa, let c be a nonnegative optional process such 
that (13. 6p holds. Denote 



T 

CtdKt — qFrp-i M = max loj 

l<i<N 



Then h > -MX^ and 



a{h) = sup Eq [h] = sup sup Eq [h] 

pG^Q)e.^'(p) 



sup sup (Eq ctdn 



where in the second equality we used (13. 5p . Lemma 5 in [lo[ implies the 
existence of an acceptable process X such that Xq = a{h) and Xt > h. It 
follows that ^ 

Xt + qFT> [ Ctdnt > 0. 







Therefore c G s^{a{h),q) C j2/(x,g). □ 

Proof of Proposition [37T]. We prove the item {i) first. Take (x, g) G J^. 
Since is an open set there exist 5 > such that (x — 5, g) G J^. Take 
X e 3^{x-5,q) then Z = X + 5 G ^(x, g) and 

Zt + g-Fr > <^ = / Mk*. 







Therefore the process that takes the constant value 5 belongs to s^{x, g). 

Let c be a nonnegative optional process such that (13. ip holds. It follows 
from Lemma 13.31 that the cadlag density process of any Q G ^'{p) is in 
for some p E l3^. Consequently, c satisfies condition (13. 6p . It follows 
from Lemma [3.41 that c G i2/(x,g). This concludes the proof of the item {%). 

To prove the assertion of the item (m), let us observe that 

{y, r) = ^ {ay, ar) for all a > and (y, r) G ^ . 

Therefore it suffices to consider (y, r) = for p G <^^. Fix p G By 

Lemma 8 in [lO| we deduce the existence of Q G M\p). By Lemma 1X51 the 
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cadlag density process (^) is in '3^(1, p). Since Q is equivalent to P 



te[o,T] 

is strictly positive for all t G [0,T] 



1. 



it follows that P 

For any G cl^ if F G '3^{l,p), condition (13. 2p follows from the 

definition of the set ^ i^iP)- Conversely, let F be a nonnegative process such 
that ([32]) holds. Then 



E 



CtYfdKt 



<1 for all c G =s/(l,0). 



By Proposition 4.3 of [18| F G ^(1) (the set Y{y) is defined in (EH])) is such 
that (O holds. I.e. Y G ^(l,p). □ 

Let L° = L° ([0, T] X fi, ^ ([0, T]) ^^,dKX P) be the vector space of 
optional process on the probability space (f2, F, P) . L*^ be the positive 
orthant of L°. For notational clarity optional stochastic processes {ct)t£[o,T] 
are identified with the corresponding elements c of L'^. As in jiof we can 
prove the following lemma. 

Lemma 3.5. The function u is upper semi- continuous. For any {x,q) G 
{u > — oo} there exists a unique maximizer to the problem 1^2. 7| j. The func- 
tion V is lower semi- continuous. For any {y,r) G {f < oo} there exists a 
unique minimizer to the problem i\2.11\) . 

Proof. Let (x"',g")„>i be a sequence in Jt^ converging to (x, g). Fix G 
£/ (x", g") such that 



E 



T 



Denote 



U(t,u,c^)dhit 



X = sup \x 

n>l 



> M(x",g") - 1/n, n>l. 



q = sup max \q, 

„>ii<i<Jv' 



Then for any n > 1 hj definition of the set s^{x'^,q"') there exists X"- G 
,^(x",g"), such that 

[ c^'dnt < + g"FT < (x - X^) + X^ + qX'^, 
Jo 
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where in the last inequahty we use Assumption 12.11 Therefore (c" 



'n>l 



c 



=2/ {x+qXq, 0). By Lemma Al.l in [3| we deduce the existence of a sequence of 

) , n > 1, and an optional process 



convex combinations c" G conv fc"', c 



.n+l 



c, such that {c'^)n>i converges to c G [dn x P) almost everywhere. 
For any {y, r) G cl^ and Y E '3^{y, r) using Fatou's lemma we get: 



E 



CtYtdKt 



< liminf E 



c'lYtdKt 



< xy + qr. 



It follows from Proposition 13.11 that cE J^{x,q). 

Thus, using uniform integrability of ([/"^(t, w, c"))^>]^ (here denotes 
the positive part of the field U), which follows from Lemma 3.12 in 18| and 
Lemma [2.61 we get: 



(3.7) 



u{x,q) > E U{t,uj,Ct)dKt 



> 



> lim sup E 



U{t, 00, c^)dKt = lim sup u(x", q'^ 



This implies upper semi-continuity of u. Moreover, by Lemma [3l2] u < 00 ev- 
erywhere in its domain. Consequently if u{x, q) > —00 then taking (x", g") = 
(x, I/), n > 1, and using (13.71) we deduce existence of a maximizer to the 
problem (12.71) . Uniqueness of the maximizer follows from strict concavity of 
U{t,u,-) for all {t,u) G [0, T] x Vl. 

The proof of corresponding assertions for the function v is similar. □ 

For each {y, r) G =Sf define the following sets: 



(3.8) 



A{y, r) = {{x, q) G : + gr < 1} , 



(3.9) 



^~(y,r)^ U ^(x,g), 

{x,q)&A{y,r) 



(3.10) 



^(y,r)^cl^~(y,r) 



where closure is taken in the topology of convergence in measure [dn x 
For the proof of Theorem 12.41 we need the following lemma. 



Lemma 3.6. Let {y, r) G ^(y, r) and ^(y, r) be given by 1^3. 9i) and ^S.lCh) 
respectively. Then 



sup E 



U{t, u, xct)dKt 



sup E 



U{t, u, xct)dKt 



X > 0. 
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Proof. For each x > let us define 



= sup E 



U {t, U, XCt)dhit 



sup E 



U(t, u, xct)dKt 



Due to concavity of U{t,u,-) botli (p and ip are concave, and (p < tp. li 
(p{x) = oo for some x > then, due to concavity, (p is infinite for all x > 0. In 
this case the assertion of the theorem is trivial. Also, it follows from Lemma 
3.21 that (p{x) > — oo for all x > 0. Therefore without loss of generality for 
the remainder of this proof we will assume that (p is finite. 

Fix X > and g G ^{y,r). Let {g"')n>i be a sequence in ^{y.r) that 
converges to g {dn x P) almost everywhere. It follows from Lemma 13.21 that 
for any 6 > there exists c G ^(y, r) such that 



E 



U{t, u, 5ct)dKt 



> — oo. 



Therefore we have: 



E 



/q U(t,u,xgt)dhit 



< E 



U (t, w, xgt + Sct)dKt 



< lim inf E 

n— f oo 

< (p{x + 6), 



U (t, CO, xg^ + 6ct)dKt 



where the first inequality is valid because U {t, u, ■) is increasing for all {t, u) G 
[0, T] X n, the second one follows from Fatou's lemma, and the third one comes 
from the fact that '^{y,r) is convex. Since cp is concave, it is continuous. As 
a result 



ip{x) 



sup E 



U (t, cj, xgt)dKt 



< lim 0(x + 6) = (p{x). 

5^0 



□ 



Proof of the Theorem 12. 4L Concavity of the function u follows from 
strict concavity of the function U{t,u,-) for each {t,u) G [0,T] x Q. Fix 
{y, r) G J^. Applying Lemma [32] and the definition of the set '^^{y, r), we get 
for each z > 0: 



(3.ii: 



sup E 



/q U{t,uj,zct)dKt 



sup E 



U{t,U,ZCt)dKt 



sup m(x, q) > — oo. 

{x,q)ezA{y,r) 
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It follows from Proposition 13.11 that 



Ye^{y,r) ^ E 



T 



CtYtdKt 



< 1 for all c G ^(y,r). 



We obtain that the sets 'io{y,r), '3^{y,r) satisfy the assumption of Theorem 
3.2 in Mostovyi [18|. Since v{y,r) < oo for all {y,r) G =Sf, using (13. lip we 
get: 

v{y, r) = sup {u{z) — z) = sup q) — xy — qr) . 

It follows from Lemma [331 that —u and v are proper closed convex functions. 
Therefore the latter equality implies the biconjugacy relations fl2.13p (see 
Rockafellar 19|, Section 12). 

The assertions of item (ii) in Theorem 12.41 follow from Lemma 13.51 To 
prove the conclusions of item [Hi), fix an arbitrary (x, q) G and define 

^{x, q) = {{y,r) E ^ : xy + qr < 1} . 

ny,r)= U ^(y^r), 

{y,r)e,^{x,q) 

and denote by ^{y, r) the closure of ^(y, r) in measure {dn x P) . Then for 
all 2 > we have 



v(z) — inf E 



Ye&{y,r) 



J^^ V{t,uj,zYt)dKt 



< 



< inf E 

YeS'{y,r) 



/q V(t,uj,zYt)dKt 



By Proposition 13.11 we can deduce that 



ce£/{x,q) E 



CtYtdKt 



inf v{y, r) < oo. 



< 1 for all Y G ^{x,q). 



Therefore the sets ^ {x, q) and ^(x, q) satisfy the assumptions of Theorem 
3.2 in 18 . Let us denote 



Yt^U'{t,urct{x,q)), tG [0,T]; z ^E 



Ct{x,q)YtdKt 



We can get from the same theorem that Y G z^{x, q) and that Y is the 
unique minimizer to the optimization problem: 



E 



T 



V{t,uj,Yt)dKt 



inf E 

Yez&{x,q) 



V{t,u,Yt)dKt 
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It Follows from Fatou's lemma and Proposition 13 . 1 1 that there exists {y,r) G 
cle^(x, g), such that Y G '3^{y,r). Here closure of ^(x, g) is taken in R^+^. 
For this {y, r) by Theorem 3.2 in [isj we have: 



E 



V{t,u,Yt)dKt 



v{y, r) = u{x, q) — xy — qr. 



Using conjugacy of the functions u and v together with Theorem 23.5 in [19 
we conclude that {y,r) G du{x,q). This proves that du{x,q) ^ 0. 

Fix {y, r) G cl^ such that I^JS), f l2T5|) . and fl2:T6|) hold for some {x, q) G 
clJ^. Then using conjugacy of U and V we obtain: 



= E 



!q {yii^^,Yt{y,r)) -U{t,u,ct{x,q)) + Ct{x,q)Yt{y,r)) di^t 



v{y, r) — u{x, q) + xy + qr. 



Since u and v and conjugate, it follows from Theorem 23.5 in 19|] that [y, r) G 
du{x, q). 

Conversely, let {y,r) G du{x,q) for some (x, g) G {m > — oo}. By Lemma 
3.51 m and v are closed functions. We also proved that they satisfy biconjugacy 
relations fl2.13p . Consequently, 



(3.12) 



u{x, q) + f (y, r) + xy + qr < 0. 



Combining this with Lemma [3.21 we deduce that \v{y,r)\ < oo. By Lemma 
3.51 this implies that there exists Y{y,r), a unique minimizer to the problem 
(12. lip . As u{x,y) > — oo by Lemma [331 we deduce that there exists c{x,q), 
a unique maximizer to the problem (12.71) . Using Proposition 13.11 we obtain 
from flXT^ 



E 



E 



/o y ^t(y^ '^)) + ^*(^' (l)^tiy, r)-U (t, w, Ct(x, q))j dKt 

lo r)^ + ct{x, q)Yt{y, r) - U {t, u, Ct{x, g)) j di^t 

< v{y, r) + xy + qr — u{x, q) < 0, 

which gives and fl235|) . 



□ 



Proof of Lemma 12. 6L Assume that (12.191) holds. Fix (x, g) G J^. It 
follows from Assumption 12.11 and by Lemma 1 in that (x, 0) G -ft' for each 
X > 0. Since is an open cone, there exists a point (xi, gi) G J^, such that 



(x, g) = A(xi, gi) + (1 - A)(x2, 0) 
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for some A G (0, 1) and X2 > 0. By Proposition 13.11 there exists a process 
6 G J^{xi,qi) that is strictly positive and is equal to a constant, which we 
denote by 6. Take c G =2/ {x2, 0), such that 



(3.13) E / U{t,uj,{l- X)ct)dKt > -00. 

Jo 

Note that such a process c exists by assumption (I2.19p . Now, 

A5+ (1 - A)c G i2/(x,g). 
Since U{t,u, ■) is increasing for all (t, w) G [0,T] x 1] we obtain from (13.131) : 



u{x,q)>E U{t,u,\6 + {1 - \)ct)dKt 



> 



> E 



> —00. 



/q f/(t,w, (1 - \)Ct)dKt 
To show that v{y, r) < 00 for any (y, r) G =Sf define the set 
'^ = {(1/7''')^ cl^ : w(?/, r) < 00} . 



By Theorem 3.2 in 18| for any x > there exists c(x), the maximizer to 
problem (12.171) . Define the process Y as: Yt = U'(t, w, Q (x)), t G [0, T]. Then 



by the same theorem E 



< 00. Using Proposition 13.11 and 



[/; v{t,u,Yt)dKt 

Theorem 3.2 in [l8| we can deduce that there exists {y,r) G cl=Sf, such that 
Y G '3^{y,r). Thus £' ^ 0. As x can be taken arbitrary large, we can show 
that the closure of ^ in R^+^ contains origin. Moreover, is convex. Now, 
for any {y,r) G ^ take {yi,ri) G =^ and (1/2, T2) G ^, such that 

(l/,r) = A(?/i,ri) + (1 - A)(|/2,r2) 

for some A G (0, 1). By Proposition 13.11 there exists a strictly positive process 
Y' G ^(?/i,ri). By construction of the set (o there exists a process F" G 
^(2/2, ''"2), such that 



E 



V{t,u,{l-X)Y^')dKt 



< 00. 
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Since V(t,u, ■) is decreasing for all (t,u) G [0,T] x f2 we deduce 
v{y, r) < E V{t, u, AF/ + (1 - A)^/')^'^* 



< E 



< oo. 



Conversely, if (12.121) holds then by Theorem 3.2 in [18| we have: 
u{x, 0) = w{x) = inf + xy) . 

y>0 

Define w(y) = inf v(y,yp), y > 0. Then from Theorem 12.41 we obtain: 

0) = inf {v{y, r) + xy) = inf + xy) . 

Convexity of —w, w, and w implies that w = w. Therefore for any y > we 
get from (12772]) : 

w{y) = w{y) < 00. 

The other assertion of f l2.19p follows trivially. □ 
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